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Abstract 

We study an unusual but robust phenomenon that appears in an 
example system of four coupled phase oscillators. The coupling is pre- 
served under only one symmetry, but there are a number of invariant 
subspaces and degenerate bifurcations forced by the coupling struc- 
ture, and we investigate these. We show that the system can have a 
robust attractor that responds to a specific detuning A between cer- 
tain pairs of the oscillators by a breaking of phase locking for arbitrary 
A > but not for A < 0. As the dynamical mechanism behind this 
is a particular type of heteroclinic network, we call this a 'heteroclinic 
ratchet' because of its dynamical resemblance to a mechanical ratchet. 

Keywords: Synchronization, coupled oscillators, heteroclinic ratchet. 



1 Introduction 

Coupled oscillators arise as simplified models for coupled limit cycle oscilla- 
tors in case of weak coupling [28]. They have been receiving an increasing 
interest not only because of their various application areas such as electro- 
chemical oscillators [291 [H! neural systems [21] but also because they 
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present analytically tractable models to understand various kinds of dynam- 
ical phenomena [2T], [151 [IB] • These include complete phase synchronization, 
partial synchronization due to the existence of stable synchronized clusters 
and slow switching between unstable clusters. The last phenomenon takes 
place if there is an attractor composed of unstable cluster states which are 
connected to each other by heteroclinic connections and thus form a hetero- 
clinic network in state space. 

Heteroclinic networks (or heteroclinic cycles in particular) are used to 
explain slow switching behaviour of physical systems where a system stays 
near a dynamically unstable equilibrium or periodic orbit for a long period, 
then changes its state to another stationary state relatively fast, and repeats 
this process for another or same stationary state. Despite the fact that 
heteroclinic networks are not structurally stable, they can be robust if the 
system considered is constrained by some conditions, such as symmetry [19l 
[T2] . This is due to the existence of invariant subspaces on which heteroclinic 
connections between saddle equilibria can exist robustly. 

This robust behaviour was first observed in examples of rotating convec- 
tion and explained by the existence of robust heteroclinic cycle in [TU] and 
|14j . Heteroclinic networks are used to explain slow switching phenomenon in 
different areas such as population dynamics [16], electrochemical oscillators 

[29] and neural systems [231 121] • They also may have some applications 
in computational engineering as some recent works [31 131 [S] suggest. Espe- 
cially in complex neural systems, the use of heteroclinic networks are quite 
promising since this means one can model persistent transient behaviour [23] . 

In case of full permutation symmetry (all-to-all coupling), a system of 

coupled oscillators can admit robust heteroclinic networks for = 4 or 
greater [3, [7] . It is important to note that due to the symmetry these hetero- 
clinic networks cannot have arbitrary forms. On the other hand, symmetry 
is not necessary for robust heteroclinic networks to exist. For example, in [1] 
it is shown that robust heteroclinic cycles can exist for coupled cell systems 
with nonsymmetric coupling structure. In this work, we study a coupled 
phase oscillator system for which robust heteroclinic networks appear in the 
phase difference space as a result of the coupling structure rather than the 
symmetry of the coupling. This gives rise to heteroclinic networks with some 
properties that are not seen for symmetric system. 

We emphasize a new type of heteroclinic network that we call heteroclinic 
ratchet as it resembles a mechanical ratchet, a device that allows rotary mo- 
tion on applying a torque in one direction but not in the opposite direction. 
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A heteroclinic ratchet on an A^-torus contains heteroclinic cycles winding 
in some directions but no other heterochnic cycles winding in the opposite 
directions. We show that this type of heteroclinic network can exist as an 
attractor in phase space resulting in noise induced desynchronization of cer- 
tain couples of oscillators in such a way that one of the oscillators has larger 
frequency than the other for all initial conditions close to synchrony state. 
This phenomenon is new in coupled phase oscillator systems and cannot take 
place in all-to-all coupled systems, since the permutation symmetry enforces 
the system to have desynchronization of a couple, if there is any, in both 
ways. We will show that the existence of heteroclinic ratchets for a coupled 
phase oscillator system is mainly related to the coupling structure. More- 
over, heteroclinic ratchets have important dynamical consequences such as 
sensitivity to detuning and noise. 

The main model for coupled phase oscillators is the Kuramoto model of 
oscillators where each oscillator is coupled to all the others by a specific 27r- 
periodic coupling function [21]. We consider the same model with a specific 
connection structure and using a more general coupling function g{x). Each 
oscillator has dynamics given by 

K ^ 
i=i 

Here 6i eT = [0, 27r) and Wi is the natural frequency of the oscillator i. The 
connection matrix {cij} represents the coupling between oscillators. = 1 
if the oscillator i receives an input from the oscillator j and = other- 
wise. The coupling function g is a 27r-periodic function. For weakly coupled 
oscillators it is well know that ([T]) will have an phase shift symmetry, that 
is the dynamics of ([T]) are invariant under the phase shift 

(^1,^2,. ^ (ei + e,^2 + e,...,^jv + e) 

for any e G T. We will initially consider identical oscillators, that is, 

Ui = u , i = 1, . . . , N (2) 

before discussing at a latter stage the effect of detuning where the oscillators 
can have different natural frequencies. Because the coupling function g is 
27r-periodic it is natural to consider a Fourier series expansion 

oo 

g{x) = '^rksin{kx + ak) (3) 
fc=i 
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where must converge to zero fast enough and a^s are arbitrary. Several 
truncated cases of the general case ([3]) have been considered in the literature: 

• Setting Tfc = for k = 2,3, . . . and ai = gives the Kuramoto model, 
which exhibits frequency synchronization and clustering phenomena 

m- 

• Setting Tfc = for /c = 2, 3, . . . but leaving arbitrary ai gives the 
Kuramoto-Sakaguchi model [25] with essentially the same dynamics as 
the Kuramoto model. 

• Setting Tfc = for k = 3,4, . . . and ^2 = gives the model of Hansel 
et al. [12]. They showed that one can observe new phenomena not 
present in the above cases. For example, taking 

= -1, r2 = 0.25, = 1.25 

and setting all other parameters to zero, they show that one can observe 
slow switching phenomenon as a result of the presence of an asymptot- 
ically stable robust heteroclinic cycle connecting a pair of saddles. 

We investigate a particular four-coupled cell system that admits a robust 
heteroclinic ratchet as an attractor only in presence of a third harmonic in 
the coupling function, i.e. we will require r-^ ^ 0. Note that, without loss of 
generality, we also set = and ri = — 1 by a scaling of time. 

The coupling structure considered in this work (see Figure [1]) arises as an 
inflation of the all-to-all coupled 3-cell network [1]. As the network admits an 
^s-symmetric quotient network there may exist symmetry broken branches 
of solutions for the coupled systems associated to this network [2]. This 
is a direct result of the Equivariant Branching Lemma [12]. We will show 
that for the coupled oscillator system we consider, such a synchrony breaking 
bifurcation includes two extra pitchfork branches as a result of the T^-phase 
shift symmetry. These correspond to the saddle cluster states which may 
form heteroclinic ratchets for some parameter region. 

This work consist of three parts. In Section [21 we will analyze the dynam- 
ics of the coupled cell system of four phase oscillators and find the invariant 
subspaces where heteroclinic networks can exist. Theorem 1 characterizes a 
syncrony breaking bifurcation in such systems. In Section [3l we consider a 
particular coupling function and explain the emergence of heteroclinic ratchet 
connecting two pitchfork branches given in Theorem 1. Finally in Section HJ 
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Figure 1: A 4-CELL NETWORK: THIS GIVES COUPLED SYSTEMS OF THE 

FORM (fT^ . Observe that the network has a single symmetry 

GIVEN BY THE PERMUTATION (12) (34). 

we discuss dynamical consequences of the heteroclinic ratchet, considering 
the influence of noise and detuning of natural frequencies. 

2 An example of four coupled oscillators 

In this section, we consider a specific case of four identical oscillators coupled 
by a connection structure shown in Figure [U More specifically, the system 
we consider is 

^i = c^i + /(0i;02,^3) 

^2 = ^2 + /(^2;^l,^4) 
^3 = C.'3 + /(^3;^1,^2) 
04 = U4 + f{9i\ 9i, 62). 

We first consider identical oscillators, that is 

00 = uji = ■ ■ ■ = uj^. (5) 

Oscillators with different natural frequencies will be considered in Section m 
We assume that the inputs to each cell are indistinguishable, i.e. 

f{x;y,z) = f{x;z,y) for all x, z G T. (6) 

We will also assume the presence of the phase shift symmetry 

fix + e;y + e,z + e) = f{x; y, z) for all x, y,z,ee T. (7) 
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This T^-symmetry arises for example in weakly coupled limit cycle oscillators 
via averaging [S]. Note that, for the present section, the form of coupling we 
assume will be more general than ([1]). 

In the following we discuss the invariant subspaces of (jl]) and give a 
result about the solution branches on the invariant subspaces that emanate 
at bifurcation from a fully synchronized solution. 

2.1 Invariant subspaces 

The network in Figure [1] has a symmetry that we characterize as follows. Let 
r be an S'2-action on generated by 

a: {01,62,63,64) {62,61,64,63). 

The symmetry of the network implies that the system (jlj) is F-equivariant 
and the fixed point subspace of F, that is, 

Fix(F) = {x G I (TX = X for all a G F} 

is invariant under the dynamics of (jl]). Note that, because F is defined on 
a torus, Fix(F) consists of two disjoint subsets each of which is invariant: 
Vf = e T"^ I ^1 = 62,63 = 64} and Vi^ = {6 e \ 6i = 62 + 71,63 = 
64 + 1:}. On the other hand, there are many other invariant subspaces which 
do not appear because of the symmetries of the network but because of the 
groupoid structure of the input sets of cells (see [13] for groupoid formalism). 

The invariant subspaces can be obtained using the balanced coloring 
method. A coloring of cells, that is, a partition of the set of all cells into a 
number of groups or colors is called balanced if each pair of cells with same 
color receive same number of inputs from the cells with any given color. Each 
balanced coloring gives rise to an invariant subspace obtained by equalizing 
the state of cells with same color. Moreover, each balanced coloring cor- 
responds to a quotient network which gives the dynamics reduced to the 
corresponding invariant subspace. 

For the system (jlj) the invariant subspaces obtained by the balanced col- 
oring method are listed in Table [H The subscripts indicate dimensions of 
subspaces and there exist a partial ordering for the set of these subspaces 
given by containment, that is, 

V.^Vy^V^C Vy. 
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Dimensions 



4 
3 
3 
3 
2 
2 
2 
2 
1 



Invariant Subspaces 











Vi = 


{6 G 


O3-- 


= ^4} 


vi = 


G 


62-- 


= e,} 


Kg _ 


{e G 


9i-- 


= ^3} 


1^2 = 


G 1 


9i = 


= d-i, 02 = ^4} 


vf-- 


= {eeT^ 


102 


= 63 = 64} 


Vf- 


= {eeT^ 




= 03 = 04:} 


Vf- 


= {eeT^ 




= 02, 03 = 04:} 


Vi = 


{6 eT^\ 


91 = 


^ 02 = 03 = 04} 



Table 1: INVARIANT SUBSPACES FORCED BY THE COUPLING STRUCTURE 

IN Figure [T] for the system (jH) 



This ordering of invariant subspaces is illustrated in Figure [21 

Consider the balanced coloring {3,4}, where only third and forth cells 
have same color. The corresponding invariant subspace is and the quo- 
tient network is the S'3-symmetric all-to-all coupled 3-cell network (see Table 
[2]). Necessarily all the fixed point subspaces of this 3-cell quotient lift to 
some invariant subspaces of the 4-cell system and these are labelled by the 
superscript s. Note that Vf is the only one of these that is contained in 
Fix(r), but there are some pairs of subspaces for which one subspace is re- 
lated to the other by the symmetry of the system, namely (riVf) = Vf and 
(j{V^) = V^. As a result, the quotient networks corresponding the subspaces 
Vr^ and V^ are also symmetrically related (see Table [2]). 

Exploiting the phase shift symmetry ([7]), the 4-dimensional system (jl]) 
and can be reduced to a 3-dimensional one by defining new variables 

(01,02,03) := (^1-^3,^2-^4,^3-^4) 

so that 

01 = /(0i;02 - 03,O)-/(O;0i,02 - 03) 

02 = /(02;01+03,O)-/(O;0i+03,02) (8) 

03 = /(03; 01 +03,02) - /(O; 01 + 03,02)- 

The symmetry of the system (jl]) has implications for this system. Let F 
be an S'2-action on T'^ generated by p : (0i,02,03) — (02,0i,— 03)- Then 
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Figure 2: CONTAINMENT OF THE INVARIANT SUBSPACES GIVEN IN TABLE 

[TJ ^ Vy MEANS c Vy. The subscripts indicates the dimen- 
sions OF THE INVARIANT SUBSPACES AND THE SUPERSCRIPT S LABELS 
THE FIXED POINT SUBSPACES RELATED TO THE S'3-SYMMETRY OF THE 
QUOTIENT NETWORK FOR 9^ = 64,. 

the system ([8]) is F equivariant. In this case the fixed point subspaces are 
the fines {0 g | 0i = 02, 03 = 0} and {0 e | 0i = 02, 03 = vr}. 
Otfier invariant subspaces can be obtained projecting tfie previously found 
invariant subspaces onto T'^. Tfiese are iUustrated in Figure [3l 

2.2 Synchrony breaking bifurcations 

In [2], it is sfiown tfiat any coupled cell system tfiat fias a connection structure 
as in Figured] admits an S'3-transcritical bifurcation on at tfie origin. More 
concretely, tfiere exist tfiree transcritical brancfies of unstable solutions on 
¥2^, ¥2'^, and ¥2^ simultaneously emanating from tfie origin if /x(0) — /^^(O) = 
and some transversality inequalities are satisfied. However, for tfie coupled 
pfiase oscillators of type (jl]), apart from tfie connection structure, dynamical 
properties affect tfie bifurcation scfieme. Now we will sfiow in Tfieorem[T]fiow 
tfie T^-symmetry of / gives rise to a pitcfifork bifurcation on V2 tfiat takes 
place simultaneously witfi tfie transcritical bifurcations mentioned above. 
Tfie occurrence of simultaneous brancfies on invariant lines is not only a 
consequence of tfie Equivariant Brancfiing Lemma [12] but also a result of 
tfie connection structure and tfie property of tfie individual dynamics, tfiat 
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Balanced 
Colourings 


Invariant 
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Quotient 
Networks 
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Vi 








03 = 64 
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{2,4} 




N2: \ \ / 












er^=^;^\p^ '/l 


{1,3} 




N3: \ f J 






6i 



Table 2: Quotient Networks for the Three Dimensional Invari- 
ant Subspaces V{, Vi, and Vi of the 4-cell system (II]) 



9 




Figure 3: INVARIANT SUBSPACES GIVEN IN TABLE 1 PROJECTED ONTO 

(represented by a unit cell in M^). Subscripts indicates the 
subspace dimensions on t^) 



is the T-^-symmetry of /. 

Theorem 1 Assume that a is a parameter of the system If f satisfies 
fx{0, a*) = 0, /xa(0, a*) 7^ 0, and fxxxi^, «*) 7^ then there exist a pitchfork 
bifurcation of the origin of ^ on V2 at a = a* appearing simultaneously with 
the transcritical bifurcations on , ¥2'^ and V2^ . 

Remark 1 A direct consequence of the TheoremUlis that a generic bifurca- 
tion of the fully synchronized periodic solution [x, x, x, x) of will give rise 
to three branches of periodic solutions of the form 

{x,y,x,x) 
{y,x,x,x) 
{x,x,y,y) 

and two other branches of the form {x,y,x,y), where the first three appear 
by transcritical bifurcations and the final two via a pitchfork bifurcation. 
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Adjacency matrix 


eigenvalues and eigenvectors 


A = 


/ 1 1 \ 
10 1 
110 

1 1 yi 




/ii = -l, z/i = (1,-1,0,0)'^' 

= -1, z^2 = (o,-i,i,ir 
/i3 = o, z/3 = (1,-1,1, -ir 

^4 = 2, 1^4= (1,1,1,1)^ 



Table 3: ADJACENCY MATRIX OF THE NETWORK IN FIGURE [T] WITH 
EIGENVALUES AND EIGENVECTORS 



Proof. Consider the adjacency matrix A of the network (see Table [3]). 
The eigenvalues of A and partial derivatives of and fy (/^ = fy) at the 
origin determine the stability of the origin (see Proposition 2 in p]). The 
eigenvalues of (E]) at the origin are 

Aj = /x(0, a) + HifyiO, a) (9) 

where //^ is an eigenvalue of A and i = 1, 2, 3. The eigenvectors of ([8]) are the 
same as the A's. It is important to note that the phase shift symmetry 
of (jlj) induce a relation between partial derivatives: 

+ + = 0. (10) 

This can be obtained taking the derivative of ([7]) with respect to e, and 
([6]) implies fy = fz Thus, there exist a linear relationship between partial 
derivatives 

fee = -2fy. (11) 

Derivatives of (ITOl) with respect to x and y give 

fxx = '^fyx — ^fyy (12) 
fxxx = '^fyxx- (1*^) 

The Eq. [9] and [11] imply that the eigenvalues A, become zero simultaneously 
for all invariant lines passing through the origin when /^.(Oja) = 0. To 
see that there exist a pitchfork branch on V2 we consider the solutions of 
type (x, x + u/2,x, X + u/2). Substituting this into ([H]) and using the Eq. 
m one gets ii = F{u) := /(O, 0, —u, a) — /(O, u, 0, a). Thus the assumptions 
fxx{0, a*) ^ 0, /^^^(O, a*) ^ and the Eq.'s[IIl[I2and[T3]imply the pitchfork 
bifurcation conditions {d^F/du^){0,a*) = 0, {d^F/dXdu){0,a*) ^ and 
{d^F/du^){0,a*) ^ 0. Since these also imply the assumptions of Theorem 
1 in [2], there exist simultaneous transcritical bifurcations on Vg*^, Vg*^ and 
Vf. m 
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3 Robust heteroclinic ratchets for the system 
of four coupled oscillators 

In the previous section, it is shown that the connection structure of the sys- 
tem (jlj) induce the existence of invariant subspaces. These subspaces persist 
under the perturbations that preserve the connection structure. For this rea- 
son, as in symmetric systems, one can find robust heterochnic networks laying 
on the invariant subspaces of the system (j4]). By "robust" we mean the per- 
sistence under the small perturbations that preserve the coupling structure. 
We will see that for the phase difference system dH]) some unusual heteroclinic 
networks exist, which are not seen for symmetric systems. We distinguish 
one type of these heteroclinic networks, which we call as heteroclinic ratchet 
because it includes connections that wind around the torus in one direction 
only. 

Definition 1 For a system on T^, an invariant set is a heteroclinic ratchet 
if it includes a heteroclinic cycle with nontrivial winding in one direction 
but no heteroclinic cycles winding in the opposite direction. More precisely, 
we say a heteroclinic cycle C parametrized by x{s),s G [0,1) has nontrivial 
winding in some direction if there is an angular variable P : R with 

P(T^) = [0,27r) andP{x{0)) = such thatlims^i P{x{s))-\ims^o P{x{s)) = 
2ti. a heteroclinic cycle winding in the opposite direction would similarly have 
\mis-*i P{x{s)) — lim^^o = — Svr. 

Remark 2 If a system has a heteroclinic ratchet, then there exist pseudo- 
orbits winding in one direction on the torus. 

In this section, we will first explain how a heteroclinic ratchet emerges for 
the system ([H]) after a synchrony breaking bifurcation. Then, we will discuss 
the stability of the heteroclinic ratchet and exhibit a coupling function g for 
which the heteroclinic ratchet is an attractor. Finally, a heteroclinic network 
with different structure is shown to exist for other parameter values. 

3.1 Heteroclinic ratchets for the four coupled oscilla- 
tors 

We consider the particular case of (jlj): 

f{x;y,z) = g{x-y)+g{x- z). (14) 
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Using fll4l) . we can write the phase difference system with identical natural 
frequencies given in Eq. [H] in the form 

01 = fl-l^l + 03 - 02) - - fl-l^S - 02) 

02 = fi'(02 - 03 - 0l) +5'(02) - fi'(-03 - 0l) - 5'(-02) (15) 

03 = fi'(-0l) +5'(03 - 02) - fi'(-03 - 0l) - fi'(-02)- 

Here the new variables are the phase differences 0i := — ^3, 02 '■= (^2 — Ga, 
and 03 := 6^ — 64^. We consider the coupling function g up to three harmonics: 

g{x) = — sin(x + ai) + r2 sin(2x) + r^, sin(3x). (16) 

For this coupling function, there may exist different types of robust het- 
eroclinic networks for different parameter values. We first demonstrate a 
heteroclinic ratchet that exists for an open set of parameters. 

Heteroclinic networks are usually exceptional phenomena, but they can 
be robust if the associated heteroclinic connections lie within invariant sub- 
spaces [in]. For f[T^ and ffT^ there are invariant subspaces that are found 
in the previous section for a more general system ([S]) (see Figure [3]). For the 
parameter set 

(«i,r2,r3) = (1.4,0.3,-0.1) (17) 

we identify robust heteroclinic connections from the equilibrium p to q = 
a{p) = 27r — p on one of these invariant subspaces, namely V^, using the 
simulation tool XPPAUT [TT] (see Figure S^). Recall that the subspaces 
and are mapped to each other by the symmetry a. Thus, the presence of 
a connection from p to g on implies the presence of another connection 
on that connects q to p. Therefore, a heteroclinic network exists on 
for the parameter set f[T7|l (see Figure Hb). Note that this is a heteroclinic 
ratchet since it includes phase slips in the directions +0i and +02. 

The equilibria p and q lie on V2 = U and they bifurcate from 
the origin via a pitchfork bifurcation simultaneously with other transcritical 
branches of solutions on Vf^, V^"^ and ^2^*^. This synchrony breaking bifurca- 
tion is discussed in Theorem [H Although we cannot rule out the possibility 
of the presence of more complex behaviours near this bifurcation, we nu- 
merically find the heteroclinic ratchet for the parameter values close to the 
bifurcation point. This suggests that the bifurcation given in Theorem [1] may 
be associated with a global bifurcation to a heteroclinic ratchet. 

The heteroclinic ratchet found for the parameter set f|T7|) is an asymp- 
totically stable attractor. The asymptotic stability of robust heteroclinic 
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Figure 4: Heteroclinic Ratchet for the system ( TT51 ) with the 

PARAMETER SET (ITTf). SOURCES, SADDLES AND SINKS ARE INDICATED 
BY SMALL DISKS FILLED WITH WHITE, GREY OR BLACK COLOR. (a) 

Phase portrait on ^3^. The horizontal axis is (0i-axis) and 

THE VERTICAL AXIS IS V2 (03-AXIs). (b) THE HETEROCLINIC RATCHET 
ON THE BOUNDARY OF T^. (c) THE HETEROCLINIC RATCHET SEEN ON 
THE LIFT OF TO M^. 



14 



networks can be observed by considering the transversal, contracting and 
expanding eigenvalues at the equlibria p, that is, Xt{p), K{p), and Xeip) re- 
spectively [201 . Since in our example there is no transversal direction, and 
p and q are symmetrically related, a heteroclinic network connecting the 
equilibria p and q is asymptotically stable if \Xe{p) / \c{p)\ < 1 and unsta- 
ble if \Xe{p) / Xc{p)\ > 1- For the parameter set ffT7|l . the equlibrium is at 
p = 1.4432. Then, Xe{p) and Xc{p) are 0.74 and —1.2 by linearizing 0151] at p 
(see Eq. |24|) . This implies asymptotic stability of the heteroclinic ratchet. 

Note that, since the condition for the asymptotic stability is open and the 
heteroclinic connections are robust, one can find an open set in parameter 
space {(ai,r2,r3) | < r2,r3,0 < ai < 27r}, for which the system (HM 
admits an asymptotically stable robust heteroclinic ratchet. On the other 
hand, for the system f|T5|) . the robust heteroclinic ratchet connecting a pair 
of saddles p and q on cannot be asymptotically stable if rs = (see 
Appendix). Therefore, the heteroclinic ratchets for the system f|T5l) cannot 
be asymptotically stable unless the third or higher harmonics of the coupling 
function g are taken into account. 

3.2 Bifurcation between heteroclinic networks 

Although the subspace does not include any part of the heteroclinic net- 
works, the dynamics restricted on this subspace, that is, the dynamics of the 
network Ni (see Table [2]) gives rise to a bifurcation from a heteroclinic cycle 
to a heteroclinic ratchet as seen in Figure [51 The detailed bifurcation analysis 
of the 3-cell all-to-all coupled oscillators with a coupling function having the 
first two harmonics is given in |5]. There, it is stated that apart from the 
transcritical bifurcation of the origin there exists a saddle node bifurcation 
on invariant lines. In the reverse direction at this saddle-node bifurcation, for 
system (fT5l) a heteroclinic cycle bifurcates to a heteroclinic ratchet as seen in 
Figure [SJd. This bifurcation should also exist for nonzero values and thus 
one can obtain the heteroclinic cycle in Figure [5]i as attracting. In fact, for 
the parameter set 

(«i,r2,r3) = (1.2,0.3,-0.05), (18) 

the same cycle exists and it turns out to be stable since Xe{p) = 0.68 and 
Xc{p) = —0.70. Thus the heteroclinic cycle for (ITSl) attracts nearby points 
with 01 and 02 less than 27r and repells other nearby points with 0i or 02 
greater than 27r to the sink s. That is, this heteroclinic cycle has a basin 
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(a) (b) (c) 




Figure 5: PHASE PORTRAITS ON FOR r = 0.3 AND (a) a = 1.2, 
(b) a = 1.315, AND (c) a = 1.4 demonstrating a bifurcation from 

A HETEROCLINIC CYCLE TO A HETEROCLINIC RATCHET SHOWN IN (d) 
AND (e), respectively. (For each graph the HORIZONTAL AXIS IS V^^ (01- 
AXIS) AND THE VERTICAL AXIS IS V2 ((^3-AXIS). SOURCES, SADDLES AND SINKS ARE 
INDICATED BY SMALL DISKS FILLED WITH WHITE, GREY OR BLACK COLOR. THE PARTS 
OF THE HETEROCLINIC NETWORKS ARE SHOWN BY THICK LINES.) 



with positive measure, so it is a Milnor attractor, though not stable. This 
type of a heterochnic cycle is also unusual for symmetric systems. 

4 Discussion and dynamical consequences of 
the heteroclinic ratchet 

This paper has so far demonstrated that the system of four coupled oscilla- 
tors in Figure [1] with identical natural frequencies Ui can support a robust 
heteroclinic attractor analogous to a mechanical ratchet. In this section we 
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consider the response of such an attractor to imperfections in the system; in 
particular we consider the effect of setting the detunings 




= Ui — UOj 



nonzero, and the effect of adding noise to the system. The frequency locking 
response to detuning and/or noise gives signatures of the presence of the 
ratchet. 

For typical trajectories in terms of the original phases 9i{t) G M one can 



Definition 2 We say the ith and jth oscillators are frequency synchronized 

on an attractor of the system if all trajectories approaching the attractor 
satisfy flij = 0. 

Note that a stronger notion of synchrony is phase synchronization; we say 
the ith and jth oscillators are phase synchronized ii all trajectories approach- 
ing the attractor have 9i{t) — Oj{t) bounded in t. Phase synchronization is 
a sufficient condition for frequency synchronization, but the converse is not 
always true as we see below. 

4.1 Response of the system to detuning 

Note that in the case of identical natural frequencies, the oscillators of the 
original system are frequency synchronized for all trajectories; this follows 
because trajectories of the reduced phase difference system are trapped inside 
a bounded invariant region, and so they are phase synchronized. As soon as 
Aij 7^ for some i,j this may no longer be the case. Here, we choose three 
independent detuning variables as A13, A24, and A34 so that the natural 
frequencies can be written as 



define the average frequency of the ith oscillator f2j = lim, 
frequency difference 



4^ and the 



■' t^oo t 



UJi = UJ + Ai3 + A34 

tU2 = ^ + A24 
UJ3 = UJ + A34 



(19) 



a;4 = u. 
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Figure 6: THE MAIN GRAPH SHOWS THE FREQUENCY DIFFERENCE l^ia 
FOR (dD WITH PARAMETERS (ITTf ) AS A FUNCTION OF DETUNING A13 BE- 
TWEEN THE FIRST AND THIRD OSCILLATOR FOR A24 = A34 = 0. NOTE 
THAT OSCILLATORS REMAIN FREQUENCY SYNCHRONIZED FOR A13 < 
BUT QUICKLY BREAK SYNCHRONY FOR A13 > 0; THIS IS EVIDENCE OF 
THE ATTRACTOR BEING A HETEROCLINIC RATCHET. THE INSETS SHOW 
TIME EVOLUTION OF THE PHASE DIFFERENCES (pi FOR A POSITIVE AND 
A NEGATIVE VALUE OF A13; OBSERVE THAT OSCILLATORS 1 AND 3 ARE 
PHASE AND FREQUENCY SYNCHRONIZED FOR A13 < BUT NEITHER PHASE 
NOR FREQUENCY SYNCHRONIZED FOR A13 > 0. 



18 



Using (fT^ instead of (jSj), phase difference system ([S]) can be rewritten as 



0: 
0: 



'3 



'2 



1 



Al3 + /(0i; 02 - 03, 0) - /(O; 01, 02 - 03) 
A24 + /(02; 01 + 03, 0) - /(O; 01 + 03, 02) 
A34 + /(03; 01 + 03, 02) - /(O; 01 + 03, 02) 



(20) 



An interesting thing about the heterochnic ratchet (such as that illus- 
trated in Figure H]) is that the qualitative response to detuning depends on 
the sign of the detuning. An example showing Qi^, the difference between 
the observed average frequencies of the oscillators 1 and 3, as a function of 
Ai3 is given in Figured Considering (I2UI) . one can observe that since the 
heteroclinic ratchet includes winding connections in the +0i direction but no 
connections winding in the — 0i direction, the oscillator system responds to 
Ai3 > by breaking frequency synchronization of the oscillator pair (1,3), 
whereas A13 < leaves the frequency synchronization unchanged, Q13 = 0. 
There is a similar response for the difference between oscillators 2 and 4 as 
can be seen by the symmetry of the original system. Small positive and/or 
negative detunings A34 do not have any qualitative effect on dynamics of 
( !20|) near the heteroclinic ratchet considered, since it does not include wind- 
ing connections in the -|-03 or —03 directions. 

4.2 Response of the system to noise and detuning 

Here, we consider the effect of additive white noise with amplitude e for the 
system fl20|) with A34 = and A13 = A24 = A. Recall that the heteroclinic 
cycle shown in Figure H] contains two nonwinding and two winding trajecto- 
ries, and in the ideal case (no noise and no detuning) a solution converging to 
the heteroclinic ratchet oscillates near the nonwinding trajectories. However, 
addition of noise to the system without detuning will cause phase slips in +0i 
and -|-02 directions such that winding will be present even for arbitrary low 
amplitude e (see Figure [7]). 

Let us define a winding frequency of the system 1^ as Q = {ftrs + 
^24)/(2vr) and the corresponding winding period as T = For a given 

noise amplitude e and detuning A, the winding frequency Q {e, A) can be 
obtained numerically as in Figure [HI Even in the presence of negative detun- 
ing A < 0, arbitrarily low amplitude noise will eventually cause fluctuations 
such that the winding trajectories in the ratchet are visited. This can be 
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Figure 7: A SOLUTION OF THE SYSTEM (fTSi) WITH NO DETUNING AND 
ADDITIVE WHITE NOISE (AMPLITUDE = lO"*") FOR THE PARAMETER SET 

( TT71 ). Noise causes the system to have repeated phase slips in 

THE +01 AND +02 DIRECTIONS. 

seen from Figure [8^, where Q is plotted as a function of A < for different 
noise amplitudes e. 

The effect of noise on the dynamics near the heteroclinic ratchet is differ- 
ent when A > is considered. In this case noise can cause fluctuations such 
that nonwinding trajectories are visited more frequently than in the case of 
positive detuning without noise. This happens only when < A <^ e, and 
diminishes the observed winding frequency Q. 

Note that the winding period T in the absence of noise varies linearly 
with log (A) for < A <C 1 (see Figure [Hb)- It is because T can be expressed 
in terms of A as 

T(0, A) = (0, A) = In (A) = log (A) , 

as expected from the residence time near an equilibrium of a perturbed ho- 
moclinic cycle where A is the most positive eigenvalue at the saddle 
and log = logio- case, A = 0.74 as found in Section [3] and the cor- 

responding slope of line representing the relation between T and log (A) is 
— In (10) /A = —3.11, consistent with simulations (see FigurelHt). 

In the absence of detuning the winding period depends on the noise am- 
plitude in a similar way but with a multiplier 2, that is T(£:,0) = 2 T{0,e). 
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In order to see this, recall that the heteroclinic ratchet contains one winding 
and one nonwinding trajectory from p (or q). Since a solution converging to a 
heteroclinic network spends most of its time near equilibria we can consider 
the effect of weak noise as perturbations near the equilibria. Considering 
the lower (upper) equilibrium p (g), nonwinding and winding trajectories are 
chosen with equal probabilities in case of the unbiased homogeneous noise 
as a result of the presence of invariant subspace (^3^)- Therefore, on av- 
erage, a trajectory in the presence of weak noise approaches both equilibria 
p and q in one winding period. Thus, the winding period is twice as large 
as the winding period for e = and A > where the trajectories passes 
one equilibria in each winding period as only the winding trajectories of the 
ratchet are visited. The consequence of this can also be seen in Figure [Ht>, 
where (e. A) = n (0, e) /2 for < A < e. 



4.3 Frequency synchronization without phase synchro- 
nization 

Adding unbiased homogeneous noise (without detuning) can lead to fre- 
quency synchronization without phase synchronization; one can have a situa- 
tion where 0i and 02 are frequency synchronized but 0i — 02 is unbounded. It 
is because the presence of unbiased noise means that the average frequency 
of the phase slips in the +0i and +02 directions should be equal, that is 
hmi_oo ^ = 0. 

Using the usual phase variables we can write this as 

hm ^1-^3-^2 + ^4 ^ Q_ (21) 

Due to the symmetry of the system when the detunings are zero, we have 
^34 = limt^oo ^ = lim^^oo ^ = 0. Thus, implies ^12 = lim^^oo ^ = 
0, namely, the frequency synchronization of the oscillators 1 and 2. 

As a result, on the heteroclinic ratchet, arbitrary small homogeneous noise 
will cause all oscillator pairs to lose phase synchronization. Moreover, the 
oscillator pairs (1,3) and (2,4) lose their frequency synchronization, whereas 
the pairs (1,2) and (3,4) maintain their frequency synchronization but lose 
phase synchronization. 
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Figure 8: WINDING FREQUENCY Q PLOTTED AGAINST log (A) FOR (a) 
A < 0, (b) A > AND ADDITIVE NOISE OF AMPLITUDE 6. THE COR- 
responding winding period t = is plotted in (c) for a > 0. 
Note that for |A| < £, noise dominates causing a A-independent 
winding, while a > e implies winding and a < -e gives no wind- 
ING. The winding period T varies linearly with log (A) until noise 

EFFECTS DOMINATE. 
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4.4 Other comments 

As the existence and robustness of heteroclinic ratchets rehes only on the 
presence of invariant subspaces and the existence of robust heterochnic cycles, 
we believe that heteroclinic ratchets will be present in a variety of coupled 
dynamical systems. Moreover, they will not occur in purely symmetry-forced 
heteroclinic networks because these will have unstable manifold branches that 
are symmetrically related. 

The four cell example we have discussed here is interesting in that we 
believe it is in some sense the simplest; for example, robust heteroclinic 
attractors cannot occur in fewer than four globally coupled oscillators. In 
applications, one can think of the network as a possible dynamical motif [30] , 
i.e. a dynamical building block for network with a more complex function. 
Motifs in networks have been investigated in different areas since the work 
of Milo et.al. |22], and asymmetrically coupled small networks are found to 
exist in neural networks as functional motifs [26] . 

The analysis of the considered system in the presence of detuning shows 
that extreme sensitivity to detuning [B] may be a subtle phenomenon with for 
example rectification properties, and we conjecture such dynamical functions 
may be of use for information processing, for example in neural systems. 

There remain a number of questions and details to be investigated for the 
example presented here; for instance, understanding the detailed dynamics 
on adding nonzero detuning will be quite a challenge, as will be obtaining a 
full understanding of the bifurcation structure. 
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Appendix: Unstability of the heteroclinic ratchet 

for rk = 0, /c = 3, 4, . . . 

In Section [31 it is shown that for the system f[T5]) . an asymptotically stable 
heteroclinic ratchet exists that connects the equilibria p and q. Here, we 
show that this heteroclinic ratchet cannot be asymptotically stable if only 
the first two harmonics of the coupling function is considered. That is, 

g{x) = — sin(x + ai) + r2 sin(2x + 02). (22) 
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The equilibria p = (0, 0,^3) and q = (0, 0, 27i — p^) in V2 are given by 

P3 = cos . 23 

\2r2 cos Q!2 / 

This can be obtained from (fT5l) by setting 01 = 02 = 03 = 0. Let us calculate 
the eigenvalues at p. Linearising (ITS]) at p gives 

Ai,2 = g'iTp) + 2g'i0), A3 = + g'hp), (24) 

where Ai and A2 corresponds to the eigenvectors in V^^ and respectively, 
and A3 is the radial eigenvalue which corresponds to the eigenvector in V2 = 

vinvi. 

For the existence of an asymptotically stable heteroclinic network con- 
necting the equilibrium p to its symmetric image q = p{p) the following 
conditions are necessary: 



Existence of nodes p and q: 



cos ai 



< 1 (25) 



2r2 cos a2 

Negative radial eigenvalue: A3 = g'{p) + g\—p) < (26) 
Asymptotic stability condition: Ai + A2 = g'{p) + g\—p) + 4(7'(0) < (27) 

We first assume r2 cosa2 < 0. From ( l26l) we have 



2 cospcosai + 4r2 cos 2|)cosa2 < (28) 
2 cospcosai + 8r2 cos^pcosa2 — 4r2 cos 0^2 < 0. (29) 



Substituting (l23l) we get 



r2 cos a2 
Our assumption then follows 



cos^ "1 , 

4r2 cos 02 < 0. 



cos^ ttl 



4r2 cos^ a2 



which contradicts (!25l) . On the other hand, if we assume r2Cosa2 > 0, the 
condition fl271) cannot be satisfied since 



A1 + A2 = 9'{p)+9'{-p)+^9'{^) 

= —2 cos p cos ai + 8r2 cos^ p cos 02 — 4r2 cos 02 — 4 cos ai + 8r2 cos 02 
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and substituting (1251) one gets 

cos^ tti 2 cos^ ai 

Ai + A2 = 1 h 4r2 cos ^2 — 4 cos ai 

r2 cos 0:2 f2 cos a2 

cos «! 



2-^/^2 cosa2 1 > 0. 



^r2 cos tt2 

Thus, the expanding eigenvalue is greater in absolute value than the con- 
tracting eigenvalue. 
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